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Abstract. Farkas' lemma is a fundamental result from linear programming 
providing linear certificates for infcasibility of systems of linear inequalities. In 
semidefinite programming, such linear certificates only exist for strongly infea- 
sible linear matrix inequalities. We provide nonlinear algebraic certificates for 
all infeasiblc linear matrix inequalities in the spirit of real algebraic geometry. 
j^JQf More precisely, we show that a linear matrix inequality L(x) y is infeasiblc 

r ~{ , if and only if —1 lies in the quadratic module associated to L. We prove expo- 

nential degree bounds for the corresponding algebraic certificate. In order to 
get a polynomial size certificate, we use a more involved algebraic certificate 
motivated by the real radical and Prestcl's theory of semiordcrings. Com- 
pletely different methods, namely complete positivity from operator algebras, 
are employed to consider linear matrix inequality domination. 



A linear matrix inequality (LMI) is a condition of the form 

n 

L(x) = A + X i A i ^ ( x e RH ) 

i=l 

where the Ai are symmetric matrices of the same size and one is interested in the 
solutions x £ R™ making L(x) y 0, i.e., making L(x) into a positive semidefinite 
matrix. The solution set to such an inequality is a closed convex semialgebraic 
subset of W 1 called a spectrahedron. Optimization of linear objective functions 
over spectrahedra is called semidefinite programming (SDP) [BV, To, WSV]. In 
this article, we are mainly concerned with the important SDP feasibility problem: 
When is an LMI feasible; i.e., when is there an a; £ M. n such that L(x) > 0? 

Note that a diagonal LMI (all Ai diagonal matrices) is just a (finite) system of 
(non-strict) linear inequalities. The solution set of such a linear system is a (closed 
convex) polyhedron. Optimization of linear objective functions over polyhedra is 
called linear programming (LP). The ellipsoid method developed by Shor, Yudin, 
Nemirovskii and Khachiyan showed at the end of the 1970s for the first time that 
the LP feasibility problem (and actually the problem of solving LPs) can be solved 
in (deterministically) polynomial time (in the bit model of computation assuming 
rational coefficients) [Sr, Chapter 13]. Another breakthrough came in the 1980s 
with the introduction of the more practical interior point methods by Karmarkar 
and their theoretical underpinning by Nesterov and Nemirovskii [NN, Ne]. 

The motivation to replace the prefix "poly" by "spectra" is to replace "many" 
values of linear polynomials (the diagonal values of L(x)) by the "spectrum" of 
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L(x) (i.e., the set of its eigenvalues, all of which are real since L(x) is symmet- 
ric) . The advantage of LMIs over systems of linear inequalities (or of spectrahedra 
over polyhedra, and SDP over LP, respectively) is a considerable gain of expres- 
siveness which makes LMIs an important tool in many areas of applied and pure 
mathematics. Many problems in control theory, system identification and signal 
processing can be formulated using LMIs [BEFB, Par, SIG]. Combinatorial opti- 
mization problems can often be modeled or approximated by SDPs [Go] . LMIs also 
find application in real algebraic geometry for finding sums of squares decompo- 
sitions of polynomials [Las, Ma]. Strongly related to this, there is a hierarchy of 
SDP approximations to polynomial optimization problems [Lau] consisting of the 
so-called Lasserre moment relaxations. This hierarchy and related methods recast 
the field of polynomial optimization (where the word "polynomial" stands for poly- 
nomial objective and polynomial constraints). In this article, rather than trying 
to solve polynomial optimization problems by using SDPs, we borrow ideas and 
techniques from real algebraic geometry and polynomial optimization in order to 
get new results in the theory of semidefinite programming. 

The price to pay for the increased expressivity of SDPs is that they enjoy some 
less good properties. The complexity of solving general SDPs is a very subtle 
issue which is often downplayed. For applications in combinatorial optimization, it 
follows typically from the general theory of the ellipsoid method [Sr] or interior point 
methods [NN] that the translation into SDPs yields a polynomial time algorithm 
(see for instance [dK, Section 1.9] for exact statements). However the complexity 
status of the LMI feasibility problem (the problem of deciding whether a given LMI 
with rational coefficients has a solution) is largely unknown. What is known is 
essentially only that (in the bit model) LMI feasibility lies either in NP D co-NP 
or outside NP U co-NP. This will also follow from our work below, but has been 
already proved by Ramana [Ra] in 1997. The standard (Lagrange-Slater) dual of 
a semidefinite program works well when the feasible set is full-dimensional (e.g. 
if there is x € W 1 with L(x) y 0). However, in general strong duality can fail 
badly which is a serious problem since there is no easy way of reducing to the 
full-dimensional case (cf. the LMI feasibility problem mentioned above). Even the 
corresponding version of Farkas' lemma fails for SDP. 

Ramana's as well as our proof relies on a extension of the standard (Lagrange- 
Slater) dual of an SDP which can be produced in polynomial time from the primal 
and for which strong duality (more precisely zero gap and dual attainment) always 
holds. Ramana's extension is an encoding of the standard dual of a regularized 
primal SDP in the sense of Borwcin and Wolkowicz [BW]. Our dual, although 
having some superficial similarity to Ramana's, relies on completely different ideas, 
namely sums of squares certificates of nonnegativity. The ideas for this sums of 
squares dual come from real algebraic geometry, more precisely from sums of squares 
representations and the Real Nullstcllcnsatz [Ma, PD, Sc]. We believe that this new 
connection will lead to further insights in the future. 

The paper is organized as follows: We fix terminology and notation in Section 
1. Our first line of results is given in Section 2, where we give an algebraic charac- 
terization of infeasible LMIs (see Theorem 2.2.5 and Corollary 2.3.3) involving the 
quadratic module associated to an LMI. Our characterization allows us to construct 
a new LMI whose feasibility is equivalent to the infeasibility of the original LMI. 
This new LMI is canonical from the viewpoint of positive polynomials. However 
its size is exponential in the size of the primal, so in Section 3 we use real algebraic 
geometry to construct a polynomial size LMI whose feasibility is equivalent to the 
infeasibility of the original LMI, cf. Theorem 3.5.2. At the same time Theorem 
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3.5.2 gives a new type of a linear Positivstellensatz characterizing linear polynomi- 
als nonnegative on a spectrahedron. The article concludes with Section 4, where we 
revisit the [HKM] noncommutative (matricial) relaxation of an LMI and investigate 
how our duality theory of SDP pertains to (completely) positive maps. 

1. Notation and terminology 

We write N := {1,2,...}, Q, and R for the sets of natural, rational, and real 
numbers, respectively. For any matrix A, we denote by A* its transpose. 

1.1. Sums of squares. Let R be a (commutative unital) ring. Then SR mxrn := 
{A E R mxm | A = A*} denotes the set of all symmetric mxm matrices. Examples 
of these include hermitian squares, i.e., elements of the form A* A for some A € 

Recall that a matrix A € jj mxm j s called positive semidefinite [positive definite) 
if it is symmetric and v*Av > for all (column) vectors v € R m , A is positive 
definite if it is positive semidefinite and invcrtible. For real matrices A and B of 
the same size, we write A < B (respectively A -< B) to express that B — A is 
positive semidefinite (respectively positive definite). We denote by STR.™^" 1 and 
SR™ xm the convex cone of all positive semidefinite and positive definite matrices 
of size m, respectively. 

Let X = (X\, . . . ,X n ) be an n-tuplc of commuting variables and R[A] the poly- 
nomial ring. With R[X]fc we denote the vector space of all polynomials of degree 
< k, and 5ZR[X] 2 * s the convex cone of all sums of squares (sos-polynomials), i.e., 

r 

^R[A] 2 = {]>> 2 | reN)P . eM[ x]}. 

i=l 

A (real) matrix polynomial is a matrix whose entries are polynomials from R[X]- 
It is linear or quadratic if its entries are from R[2C]i or R[2C]2, respectively. A 
matrix polynomial is called symmetric if it coincides with its transpose. An example 
of symmetric matrix polynomials that are of special interest to us are sums of 
hermitian squares in R[A] mxm . They are called sos-matrices. More explicitly, 
S E M.[X] mxm is an sos-matrix if the following equivalent conditions hold: 

(i) S = P*P for some s e N and some P e R\X] SXm ; 

(ii) S = J2l=i QiQi for somc r G N and Q t e R[X} rnxm ; 

(iii) S = J2t=i ViV? for somc s G N and v t G R[X] m . 

Note that an sos-matrix S G R[X] mxm is positive semidefinite on R ra but not vice- 
versa, since e.g. a polynomial nonnegative on R n is not necessarily a sum of squares 
of polynomials [Ma, PD]. 

For a comprehensive treatment of the theory of matrix polynomials we refer the 
reader to the book [GLR] and the references therein. 

1.2. Linear pencils, spectrahedra, and quadratic modules. We use the term 
linear pencil as a synonym and abbreviation for symmetric linear matrix polyno- 
mial. 

Let R be a (commutative unital) ring. We recall that in real algebraic geometry 
a subset M C R is called a quadratic module in R if it contains 1 and is closed 
under addition and multiplication with squares, i.e., 

1 G M, M + M C M and a 2 M C M for all a G R, 

see for example [Ma]. A quadratic module M C R is called proper if —1 ^ M. 
Note that an improper quadratic module M in a ring R with i £ R equals R by 
the identity 

4a = (a+ l) 2 - (a- l) 2 for all a £ R. (1) 
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An LMI L(x) y can be seen as the infinite family of simultaneous linear in- 
equalities u*L(x)u >0(u£ R m ). In optimization, when dealing with families of 
linear inequalities, one often considers the convex cone generated by them (cf. Cl 
in the definition below). Real algebraic geometry handles arbitrary polynomial in- 
equalities and uses the multiplicative structure of the polynomial ring. Thence one 
considers more special types of convex cones like in our case quadratic modules 
(Ml from the next definition). One of the aims of this article is to show that it is 
advantageous to consider quadratic modules for the study of LMIs. Since quadratic 
modules are infinite-dimensional convex cones, we will later on also consider certain 
finite-dimensional truncations of them, see Subsection 2.3. 

Definition 1.2.1. Let L be a linear pencil of size m in the variables X. We 
introduce 

S L := {x G R" | L(x) h 0} C R™, 

C L := {c + J2 u * Lu i I c€R>o, u i G R m | 

i 

= {c+ tr(LS) | c G R> , S G 5R^ XTO } C R[X] U 
M L := [s + v i Lv i \ se J2 R t^] 2 ' Vi e R [*P} 

i 

= |s + tr(LS) | s G R\X] sos-polynomial, S G R[X} mxm sos-matrixj C R[X], 

and call them the spectrahedron (or LMI set), the convex cone, and the quadratic 
module associated to the linear pencil L, respectively. Call the linear matrix in- 
equality (LMI) 

L(x) ^0 (x G R"), 

or simply L, infeasible if Sl — 0- In this case, call it strongly infeasible if 

dist ({L{x) | x G R"}, S*R^ xm ) > 0, 

and weakly infeasible otherwise. Moreover, call L feasible if Sl 0- We say L 
is strongly feasible if there is an x G R n such that L(x) >- and weakly feasible 
otherwise. 

Note that for any linear pencil L, each element of Ml is a polynomial nonneg- 
ative on the spectrahedron Sl- In general Ml does not contain all polynomials 
nonncgative on Sl, e.g. when L is diagonal and dimS^ > 3 [Sc]. For diagonal 
L, the quadratic module Ml (and actually the convex cone Cl) contains however 
all linear polynomials nonncgative on the polyhedron Sl by Farkas' lemma. For 
non-diagonal linear pencils L even this can fail, see Example 3.6.1 below. To certify 
nonnegativity of a linear polynomial on a spectrahedron, we therefore employ more 
involved algebraic certificates (motivated by the real radical), see Theorem 3.5.2. 

2. Spectrahedra and quadratic modules 

In this section we establish algebraic certificates for infeasibility and bounded- 
ness of a spectrahedron. They involve classical Positivstellensatz-like certificates 
expressing —1 as a weighted sum of squares. 

A quadratic module M C R[X] is said to be archimedean if 

V/ G R[X] 3N eN: N - f G M. 

Equivalently, there is an N G N with N ± JQ G M for i = 1, ...,n; see [Ma, 
Corollary 5.2.4]. 
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2.1. Quadratic modules describing non-empty bounded spectrahedra. Ob- 
viously, if Ml is archimedean for a linear pencil L, then Sl is bounded. In [HKM] 
complete positivity was used to deduce that for strictly feasible linear pencils the 
converse holds. Subsequently, a certain generalization of this result for projections 
of spectrahedra has been proved by other techniques in [GN]. In this section we 
will establish the result for arbitrary bounded Sl- We begin with the relatively 
easy case of non-empty Sl (possibly with empty interior). 

Lemma 2.1.1. Let L be a linear pencil with Sl 7^ ■ Then 

Sl is bounded Ml is archimedean. 

Proof. The direction (4=) is obvious as remarked above. Let us consider the con- 
verse. We first establish the existence of finitely many linear polynomials in Cl 
certifying the boundcdncss of Sl- 

There is a ball BCR™ with S L C B and S L H dB = 0. For every x £ dB there 
is a vector u £ R™ with 

u*L(x)u < 0. (2) 

By continuity, (2) holds for all x in a neighborhood U x of x. From {U x | x £ dB} 
we extract by compactness a finite subcovering {U X1 , . . ., U Xr } of dB. Let £i := 
u*Lui £ K[X]i and 

S :={x£ R" I £i(x) > 0, . . . A(x) > 0}. 

Clearly, Sl Q S and S n dB = 0. Since Sl is non-empty by hypothesis and 
contained in B, it follows that S contains a point of B. But then it follows from the 
convexity of S together with S n dB = that S C B. In particular, S is bounded. 

Now every £j £ Cl Q Ml- Hence the quadratic module M generated by the £i 
is contained in Ml- Choose N £ N with N ± Xi > on S for all i. Fix an i and 
<5 G { — 1,1}. The system of linear inequalities 

—N + Sxi > 0, h{x) > 0, . . . ,£ r (x) > 

is infeasiblc. Hence by Farkas' lemma [Fa], there are ctj £ R>o satisfying 

- 1 = a (-N + 5Xi) + aih -\ \- a r £ r . (3) 

Note ao ^ since S 7^ 0. Rearranging terms in (3) yields N — SXi £ Cl- Since i 
and (5 were arbitrary and C'l Q Ml, we conclude that Ml is archimedean. ■ 

Surprisingly, establishing Lemma 2.1.1 for empty spectrahedra is more involved 
and will occupy us in the next subsection. 

2.2. Quadratic modules describing the empty spectrahedron. The follow- 
ing is an extension of Farkas' lemma from LP to SDP due to Sturm [St, Lemma 
2.18]. We include its simple proof based on a Hahn-Banach separation argument. 

Lemma 2.2.1 (Sturm). A linear pencil L is strongly infeasible if and only if ' — 1 £ 
C L - 

Proof. Suppose 

n 

L = A Q + J2x,A l 

i=i 

is strongly infeasible, Ai £ 5R mxm . Then the non-empty convex sets {L(x) | x £ 
R"} and SM.y^ m can be strictly separated by an affine hyperplane (since their 
Minkowski sums with a small ball are still disjoint and can therefore be separated 
[Ba2, Chapter III, Theorem 1.2]). This means that there is a non-zero linear form 



£: Sl 



nmx m 
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and a £ 1 with £(SR™ xm ) C R >Q and £({L{x) \ x £ t n }) C R <a . Choose 
B g SR mXm such that ~ 

£{A) = tr(AB) 

for all A g 5K roxm . Since ^(SR™*" 1 ) is bounded from below, by the self-duality of 
the convex cone of positive semidefinite matrices, ^ B >z 0. Similarly, we obtain 
= for i g {1, . . . ,n}. Note that a < since = ^(0) £ R >Q , so we can 
assume £{Aq) = — 1 by scaling. Writing B = ^\ u,m* with Uj g R m , we obtain 

-1 = £(Ao) = £{L(x)) = tv(L(x)J2uiU*i) = ^<I(xK. 

for all x £ K™. Hence -1 = E* G Cx- 

Conversely, if —1 g Cx, i.e., — 1 = c + J2i u i-^ u i f° r some c > and itj g R m , 
then with £? := Ei G STR"',*" 1 we obtain a linear form 

£:SR mxm ^R, A^ti(AB) 

satisfying £(SR^ xm ) C R> and | x £ R"}) = {-1 - c} C K<_i. So L is 

strongly infeasible. ■ 

Lemma 2.2.2. Let L be an infeasible linear pencil of size m. The following are 
equivalent: 

(i) L is weakly infeasible; 

(ii) S L+S i m ^ for all e > 0. 

Proof. Since all norms on a finite-dimensional vector space are equivalent, we can 
use the operator norm on R mxm . 

Suppose that (i) holds and e > is given. Choose A £ SR™g m and x £ R™ with 
\\A - L{x)\\ < e. Then L{x) + el m h 0, i.e., x £ S L+eIm . 

Conversely, suppose that (ii) holds. To show that 

dist ({L(x) | x £ R™}, 5R^ xm }) = 0, 
we let e > be given and have to find A £ SR"'*" 1 and x £ R" with 

\\L(x) -A\\ < e. 

But this is easy: choose x £ R™ with L{x) + el m >z 0, and set A := L(x) + sl m . ■ 

The following lemma is due to Bohnenblust [Bo] (see also [Bal, Theorem 4.2] for 
an easier accessible reference) . While Bohnenblust gave a non-trivial bound on the 
number of terms that are really needed to test condition (i) below, we will not need 
this improvement and therefore take the trivial bound m. Then the proof becomes 
easy and we include it for the convenience of the reader. 

Lemma 2.2.3 (Bohnenblust). For A\, . . . ,A n £ SM. mxm the following are equiva- 
lent: 

(i) Whenever Ui, . . . ,u m £ R m with E"=i u i^-j u i = for all j £ {1, . . . ,n}, then 
«! = ••• = u m = 0; 

(ii) span(Ai, . . . ,A n ) contains a positive definite matrix. 

Proof. It is trivial that (ii) implies (i). To prove that (i) implies (ii), note that 
SR? xm = m«J I ,u m € R" 1 } and E™i <A Ul = tr(^E^i for 

all m, ■ ■ ■ ,u m £ R m . The hypotheses thus say exactly that, given any B £ SM.^" 1 , 
we have 

tv(AiB) = ■■■ = tr(A„B) = B = 0. (4) 
Now suppose that span(^i, . . . ,A n ) fl S'R" 1 ^'" = 0. By the standard separation 
theorem for two non-empty disjoint convex sets (see for example [Ba2, Chapter III, 
Theorem 1.2]), span(Ai, . . . ,A n ) and SM.™Q m can be separated by a hyperplane 
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(the separating affine hyperplane must obviously contain the origin). Therefore 
there is a non-zero linear form L: SM. mxm — > R with 

L(SR™ xro ) C R> and Z,(span(Ai, . . . AO) £ R< - 

Then of course L(SR™ xm ) C R> and L(span(^i, . . . ,A n )) = {0}. Now choose 
B G SIR" 1 * 1 " such that 

L(A) = tr(AB) for all A G SR TOXm . 

Then B ^ 0, B G S"R™ xm and tr(AiB) = • • • = tr(A n B) = 0, contradicting (4). ■ 

Lemma 2.2.4. Let L be a linear pencil of size m which is either weakly infeasible 
or weakly feasible. Then there are k > 1 and u\,...,Uk G R m \ {0} such that 

YH=lK Lu i = °- 

Proof. Assume that the conclusion is not true. By Lemma 2.2.3 there are hence 
xo,Xi, . . . ,x n € R such that 

x A + x\A\ + ■ ■ ■ + x n A n y 0. 

Of course it is impossible that xo > since otherwise L(0) y 0. Also xq = 
is excluded (since otherwise L(cx\, . . . ,cx n ) y for c > large enough). Hence 
without loss of generality xo = —1, i.e., xiAi + • • • + x n A n y Aq. Choose e > 
such that 

xtAt H h x n A n y A + 2el m . 

By Lemma 2.2.2, we can choose some y G SL+ei m - But then 

A + {xx + 2y 1 )A 1 + ■■■ + (x n + 2y n )A n y 2(A Q + el m + y x A x + ■■■ + y n A n ) y 0, 

contradicting the hypotheses. ■ 

We come now to our first main theorem which is a version of Farkas' lemma for 
SDP which unlike Lemma 2.2.1 does not only work for strongly but also for weakly 
infeasible linear pencils. The price we pay is that we have to replace the finite- 
dimensional convex cone Cj, by the infinite-dimensional quadratic module Ml. Wc 
will spend most of the sequel to refine and tame this result, cf. Theorems 2.3.1 and 
3.5.2 below. 

Theorem 2.2.5. Let L be a linear pencil. Then 

S L =0 ^ -1 G M L - 

Proof. One direction is trivial since Ml contains only polynomials nonnegative on 
Sl- Wc show the nontrivial implication from left to right by induction on the 
number n of variables appearing in L. In the case n = 0, we have L G SR mxm and 
therefore S L = L t <*=S> -1 G M L . 

For the induction step suppose n > 1 and the statement is already known for 
linear pencils in less than n variables. The way we will later use the induction 
hypothesis is explained by the following claims which are weakening of the theorem 
itself. 

Note that Claim 2 is just a special case of Claim 3' which we formulate for 
the sake of clarity. The proof of Claim 3' is very conceptual and uses a tool of 
real algebraic geometry, namely Prestel's semiordcrings [PD]. For readers that are 
not familiar with this theory we prove a special case of it by an ad hoc technical 
argument. This special case of Claim 3' is stated in Claim 3 and suffices for our 
subsequent application. 

Claim 1. If S L = and ^ £ G R[X]i, then -1 G M L + (£)■ 
Explanation. After an affine linear variable transformation, we may assume 
£ = X n . Set V := L{X\, . . . ,X„_i,0). Then -1 G M L + (X n ) is equivalent to 
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— 1 £ Ml,'- By induction hypothesis, the latter follows if Sl> = 0- But emptiness 
of Sl clearly implies the emptiness of Sl'- D 

Claim 2. If S L = and ^ £ £ M L n -M L , then -1 £ M L . 

Explanation. This follows from Claim 1 using the fact that Ml H —Ml is an 
ideal in M.[X] which follows from (1). □ 

Claim 3. If S L = and + 1 £ R[X"]i such that -£ 2 £ M L , then -1 £ M L . 

Explanation. By Claim 1, there is p £ Ml and q £ M.[X] such that —1 = p + q£. 
Now 

-1 = -2 + 1 = (2p + 2q£) + ((1 + q£f - 2q£ + q 2 {-£ 2 )) 
= 2p + q 2 (-£ 2 ) + {l + q£) 2 £ M L , 
as desired. □ 

Claim 3'. If S L = 0, k > 1 and lx, . . . ,£ k £ R\X]i such that ^ ly ■ ■ -£ k £ 
M L n -M L , then -1 £ Ml- 

Explanation. Assume —1 ^ Ml- Then there is a semiordcring S of R[X] such 
that Ml C 5. The advantage of 5 over is that S n — 5 is always a prime ideal. 
Hence £j £ 5n— S for some i e {1, . . . ,fe}. But this shows that —1 ^ ML + (ii) (even 
though (4) might not be contained in Ml d —Ml). Hence Sl by Claim 1. □ 

Now we are prepared to do the induction step. Suppose Sl = 0- If L is strongly 
infeasible, then — 1 £ Cl Q Ml by Lemma 2.2.1. Therefore we assume from now on 
that L is weakly infeasible. By Lemma 2.2.4, one of the following two cases applies: 

Case 1. There is u £ R m \ {0} with u* Lu = 0. 

Of course, we can assume that L has no zero column since otherwise we can 
remove it together with the corresponding row without altering Sl and Ml- Write 
L = {£ij)i<i.j<m- By changing coordinates on M m , we can assume that u is the 
first standard basis vector, i.e., £\\ = 0. Moreover, we may assume £12 ^ 0. Then 

2pq£i2 + q 2 £22 € M L 

for all p,q £ R\X]. In particular, £^{£22 + 2p) £ M L for all p £ R[X] and therefore 
—£l 2 £ M L - Now we conclude by Claim 3 or 3' that — 1 £ Ml- 

Case 2. Case 1 does not apply but there arc k > 2 and u\, . . . ,u k £ K" 1 \ {0} 
such that X)i=i u iLui = 0. 

In this case, 

k 

£ := u\Lu\ = u *Lui £ C L n -C L Q M L n -M L 

i=2 

and we are done by Claim 2, since £ = u\Lui 7^ 0. ■ 

Corollary 2.2.6. Let L be a linear pencil. Then 

Sl is bounded Ml is archimedean. 

Proof. If S L ^ 0, then this is Lemma 2.1.1. If S L = 0, then -1 £ M L by Theorem 
2.2.5, so Ml is archimedean. ■ 

Remark 2.2.7. Note that the above corollary is a strong variant of Schmudgcn's 
characterization [Sm] of bounded basic closed semialgebraic sets as being exactly 
those whose describing finitely generated preordcrings are archimedean. Preorder- 
ings have the tendency of being much larger than quadratic modules. In general, 
a finitely generated quadratic module might describe a bounded or even an empty 
set without being archimedean, see [PD, Example 6.3.1] and [Ma, Example 7.3.2]. 
Corollary 2.2.6 says that quadratic modules associated to linear pencils behave very 
well in this respect. 
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We conclude this section with a version of Putinar's Positivstellensatz [Pu] for 
bounded spectrahedra: 

Corollary 2.2.8. Let L be a linear pencil and assume that Sl is bounded. If 
f G R\X] satisfies f\s L > 0, then / G Mr,. 

Proof. By Corollary 2.2.6, Mr, is archimedean. Now apply (a slight generalization 
of) Putinar's Positivstellensatz [Ma, Theorem 5.6.1]. ■ 

Remark 2.2.9. Let L be a linear pencil with bounded Sl- 

(1) In the case L is strongly feasible, Corollary 2.2.8 has already been proved in 
[HKM, §7] by completely different techniques, namely complete positivity from 
operator algebras. Note however that the more involved case in our approach 
occurs when L is infeasible. 

(2) From Corollary 8 it is easy to see that the quadratic module in the sense of rings 
with involution (sec [KS] ) associated to a linear pencil L of size m in the ring of 
s x s matrix polynomials is archimedean (in the sense of [KS, Subsection 3.1] or 
[HKM, §6, §7]) if the spectrahedron S L defined by L is bounded (cf. [HKM, §7]). 
Among other consequences, this implies a suitable generalization of Corollary 
2.2.8 for matrix polynomials positive definite on the bounded spectrahedron Sl 
(cf. [HS, Corollary 1], [KS, Theorem 3.7] and [HKM, Theorem 7.1]). 

2.3. Degree Bounds. Given a linear pencil L of size m and k G No, let 

m l } ■■= { + E v *i Lv i i ^ e R i£]*> »i e R w} 

» 3 

= is + tr(LS) | s G R[A] 2 fc sos-polynomial, S G R[X]™ Xro sos-matrixj 

C R[X] 2 fe+i, 

be the truncated quadratic module with degree restriction k associated to L. Note 
that M ( L 0) = C L . 

By a closer inspection of the proof of Theorem 2.2.5 we can obtain exponential 
degree bounds for the infeasibility certificate. 

Theorem 2.3.1. Let L be an infeasible linear pencil in n variables. Then 

-leMf- 1 ' 

Proof. We shall prove this by induction on n. The statement is clear for n = 0. 
Given n G N and 

n 
i=l 

we assume the statement has been established for all infeasible linear pencils with 
n — 1 variables. 

By Lemma 2.2.4, there is an u G ffi m \ {0} with u*(I m ® L)u = 0. Replacing L 
by I m ® L changes neither M, nor Sl = 0- Without loss of generality, we assume 
therefore that there is u G R m \ {0} with u*Lu = 0. Writing L = (tij)i<i,j<m and 
performing a linear coordinate change on R m , we can moreover assume £n = 0. 
Furthermore, without loss of generality, £12 7^ 0. As in Case 1 of the proof of 
Theorem 2.2.5 above, we deduce 

-l\ 2 eM^. (5) 

If £12 G R, we are done. Otherwise after possibly performing an affine linear change 
of variables on R n , we may assume £12 = X n . 
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— 1) 

our induction hypothesis, -1 £ M L , . In particular, there are 



Now L' := L{X\ 1 . . . ,X n _i,0) is an infeasible linear pencil in n — 1 variables. By 
sis, —Is M L , . In particu 

Pi e R[X] 2 n-i_! and S 



satisfying 

Let q := £V v*A n v 3 S R[X} 2 ^ 2 . Then 



-1 = 2^ + 25^^ + 1 

« j 

= 2^T p z + 2^2 VjLvj - 2gX„ + 1 

i 3 



(6) 



Since degq < 2" - 2, we have q 2 (~X n ) S Aff" 1} by (5). Taken together with 



(1 - qX n f S Aff" 1) , (6) implies -1 S M y L 

Similarly as in Theorem 2.3.1, one can obtain a bound on fc in a certificate of 
the form —Is that depends exponentially on the size m of L. 

Theorem 2.3.2. Let L be an infeasible linear pencil of size m. Then 

-lsMf"" 1 " 1 ). 

Proof. We prove this by induction on m. The statement is clear for m — 1. Given 

n 

L = A ° + E XiAl € SR[X] mxm 

i=l 

of size 77i > 2, we assume the statement has been established for all infeasible linear 
pencils of size m — 1. If L is strongly infeasible, then —Is Cl = by Lemma 

2.2.1. So we may assume L is weakly infeasible. 

Claim. There is an affine linear change of variables after which L assumes the 
form 

'b 6*1 
b V 

where b S K[2f]i, b = [h ■ ■ ■ 6 m _i]* S R[X]™ _1 , L' is a linear pencil of size 
m — 1, and frj S K[2f]i satisfy 



(2"-l) 



-tfeMl 1 ' for. ? =0,...,m- 1. (7) 

Furthermore, &o can be chosen to be either or X\. 

Explanation. By Lemma 2.2.4, there is k S N and Ui,. . . ,Uk S K™ 1 \ {0} with 
t. 

z2i = i u*Lui = 0. We distinguish two cases. 

Case 1. There is u S W n \ {0} with u* Lu = 0. 

Write L = (£ij)i<%,j<m- By changing coordinates on M m , we can assume that u 
is the first standard basis vector, i.e., in = 0. Hence 

L = 



b* 
b V 



where b = [fci 



b m -i] * S K.[X] T " 1 and L' is a linear pencil of size m — 1. As 

(i 



in the proof of Theorem 2.3.1, we deduce —b 2 S M£ for all j = 1, . . . ,m — 1 
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Case 2. Case 1 does not apply but there are k > 2 and u\, . . . ,Uk £ R m \ {0} 
such that J2i=i u*Liii = 0. 
In this case, 



£ n := u\Lu x = - ^ < Lu l e C L n -C L = A/| 0) n —M 



(o) 



i=2 



Since Case 1 does not apply, £n 7^ 0. Furthermore, since L is assumed to be weakly 
infeasible, in €" R. Hence after an affinc linear change of variables on R", we can 
assume l\\ = X\. Thus 

Xi b* 
b V 



L 



where b = \bi ■ ■ ■ 6 m _i]* G R[X]™ 1 and L' is a linear pencil of size m — 1. 
Note that 

-AXl = (1 - Xx) 2 ^ + (1 + Xtfi-XJ 
shows that —Xf e M^ 1 . Using this, one gets similarly as above that also each of 



the entries bj of b satisfies — b\ e . This proves our claim 



□ 



If one of the bj € R \ {0}, we are done by (7). Otherwise we consider two cases. 

Case a. If the linear system &o(x) = 0, b(x) = is infeasible, then we proceed 
as follows. There are ao, ■ ■ ■ ,a m —i € R satisfying 



m — 1 

3=0 



(8) 



For each j = 0, . . . ,m — 1 and 5 G R we have 



1 + Sbi 



5, \ 2 5 



f T (-6^)GM 



(i) 



by (7). Hence (8) implies 

-1 = 1 - 2 = 1 - 2 ]T ai 6j = E - 2^6,) G A4 1 



m— 1 



m— 1 



3=0 



3=0 



Case b. Suppose the linear system 60 (x) = 6(x) = is feasible. Then we 
perform an affine linear change of variables on R™ to ensure 

{x G R n I 6 (x) = 0, b(x) = 0} = {0} r x R n " r 

for some r G N. Moreover, we may assume X±, . . . ,X r are among the entries bj, 

j = 0, . . .,TO- 1. 

Now L" := 1/(0, . . . ,0,X r _(_i, . . . , X n ) is an infeasible linear pencil of size m — 1. 
By our induction hypothesis, — 1 G M^ 2 .In particular, there are s € X) R[^] 2 

with dcgs < 2™- 1 - 2, and v, G R[X]^r_ 1 2 _ 1 satisfying 



-1 = * + 5>?L" 

Introducing 

<?t := ^v*A t Vi € R[X] 2 m-i_ 2 and 
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we have 



r r 1 

(2s + 2 Y, ViL'vi - Y lltX t ) + £)((—- V^qtX t ) 2 + 2q t X t + rq?(-X 

i t=l t=l V 

r r 

2s + 2 ]T w*L Wi + ^ (— - V^qtX t ) 2 + £ rq*{-X 2 t ). 



i = i 



(9) 



Combining qf(-Xf) € M y L 

-ieMr M) . 



with - V^ft^t) 2 e Aff m (9) implies 



Corollary 2.3.3. Let L be an infeasible linear pencil of size m in n variables. Then 

Proof. This is immediate from Theorems 2.3.1 and 2.3.2. ■ 

2.4. Examples. The standard textbook example [St, WSV] of a weakly infeasible 
linear pencil seems to be 

X 1 
1 ' 

Then -1 £ C L , but -1 e AI { L 1] . Indeed, for 



L := 



we have 



Example 2.4.1. Let 



u:=\l -1-41 



-1 = —u*Lu. 
2 



L := 



X 1 
X 1 X 2 1 
1 X 1 



Then L is weakly infeasible and — 1$. 
Assume otherwise, and let 



(i) 



(10) 



where Vj £ and s e X^tS 2 wrtn degs < 2. We shall carefully analyze the 

terms v*Lvj. Write 

Vj = [qij qij q 3 j]* , and q,, = a io + b,,X\ + c 13 l 2 

with a,ij,bij,Cij G K. Then the Xf coefficient of v*Lvj equals c\j, so c 2 j = for 
all j. Next, by considering the X\X\ terms, we deduce c-^j = 0. Now the only 
terms possibly contributing to X 2 come from s, so s £ M.[Xi]2- The coefficient of 
X 2 in v*Lvj is a square, so a 2 j — 0. But now v*Lvj does not have a constant term 
anymore, leading to a contradiction with (10). 

From Theorem 2.2.5 it follows that -1 <G m£ 3) . In fact, -1 <G Af| 2) since 
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3. Polynomial size certificates for infeasibility 



Theorem 2.3.1 (or Corollary 2.3.3) enables us to reformulate the feasibility of 
a linear pencil as the infeasibility of an LMI. Indeed, let a linear pencil L in n 
variables of size m be given. Then L is infeasible if and only if there exists an 
sos-polynomial s G M.[X] and an sos- matrix S G M.[X] mxm both of degree at most 
2 n+1 - 2 such that 

-l = s + tr(LS). (11) 
By comparing coefficients, the polynomial equation (11) can of course be written as 
a system of linear equations in the coefficients of s and S. Now (the coefficient tuples 
of) sos-polynomials in M.[X] of bounded degree form a projection of a spectrahedron. 
In other words, the condition of being (the coefficient tuple) of an sos-polynomial 
in M.[X] of bounded degree can be expressed within an LMI by means of additional 
variables. This is the well known Gram matrix method [Lau, Ma]. As noted by 
Kojima [Ko] and nicely described by Hoi and Schcrcr [HS], the Gram matrix method 
extends easily to sos-matrices. 

Hence the existence of s and S in (11) is indeed equivalent to the feasibility of 
an LMI which we will not write down explicitly. The drawback of this LMI is that 
it will be large since our degree bounds for the sos-polynomial and the sos-matrix 
are exponential. 

This problem is overcome in this section, where for a given linear pencil L, we 
construct an LMI whose feasibility is equivalent to the infeasibility of the given 
linear pencil L and which can be written down in polynomial time (and hence has 
polynomial size) in the bit size of L if L has rational coefficients. Each feasible point 
of the new LMI gives rise to a certificate of infeasibility for L which is however more 
involved than the one using the quadratic module Ml- In addition to the quadratic 
module, we will now use another notion from real algebraic geometry, namely the 
real radical ideal. 

But actually we will not only characterize infeasibility of LMIs but even give a 
new duality theory for SDP where strong duality always holds in contrast to the 
standard duality theory. We will call our dual the sums of squares dual of an SDP. 
For a given (primal) SDP with rational coefficients the sums of squares dual can be 
written down in polynomial time in the bit size of the primal. 

3.1. Review of standard SDP duality. We first recall briefly the standard du- 
ality theory of SDP. We present it from the view point of a real algebraic geometer, 
i.e., we use the language of polynomials in the formulation of the primal-dual pair of 
SDPs and in the proof of strong duality. This is necessary for a good understanding 
of the sums of squares dual which we will give later. 

A semidefinite program (P) and its standard dual (D) is given by a linear pencil 
L G R[X] mxm and a linear polynomial £ G R[X] as follows: 



(P) minimize £(x) 

subject to x G R™ 
L(x) y 



(D) 



maximize 
subject to 



a 



S G SR mxm 
£-a = ti(LS) 



To see that this corresponds (up to some minor technicalities) to the formulation 
in the literature, just write the polynomial constraint £ — a = tr(LS) of the dual as 
n + 1 linear equations by comparing coefficients. 

The optimal values of (P) and (D) are defined to be 

P* := inf{£(x) | x G R", L(x) > 0} G R U {±00} and 

D* := sup{a | S G SR™, a G R, £ - a = tr(LS)} G R U {±00}, 
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respectively, where the infimum and the supremum is taken in the ordered set 
{—00} UlU {00} (where inf = 00 and sup0 = —00). 

By weak duality, we mean that P* > D* or equivalently that the objective value 
of (P) at any of its feasible points is greater or equal to the objective value of (D) 
at any of its feasible points. 

Fix a linear pencil L. It is easy to see that weak duality holds for all primal 
objectives £ if and only if 

/ E C L / > on S L 

holds for all / g R[A]i, which is of course true. By strong duality, we mean that 
P* = D* (zero duality gap) and that (the objective of) (D) attains this common 
optimal value in case this is finite. It is a little exercise to see that strong duality 
for all primal objectives £ is equivalent to 

/ > on S L ^ feC L 

for all / g R\X]i. 

As we have seen in Subsection 2.4, this fails in general. It is however well-known 
that it is true when the feasible set Sl of the primal (P) has non-empty interior 
(e.g. if L is strongly feasible). For convenience of the reader, we include a proof 
which has a bit of a flavor of real algebraic geometry. 

Proposition 3.1.1 (Standard SDP duality). Let L g SR[A] mxm be a linear pencil 
such that Sl has non-empty interior. Then 

f>0onS L / g C L 

for all f g R[X}i. 

Proof. In a preliminary step, we show that the convex cone Cl is closed in R[A]i. 
To this end, consider the linear subspace U := {u g R ,n | Lu = 0} C R m . The map 

n 1 

<p: R x (R m /U) m -> C L , (0,%, . . . ,u m ) -> a 2 +^u*L Ul 

t=i 

is well-defined and surjective. 

Suppose ip maps (a,u\, . . . ,u m ) € (R m /U) m to 0. Fix i g {1, ...,m}. Then 
u*L(x)ui = for all x € Sl. Since L(x) >: 0, this implies L(x)ui = for all x g Sl- 
Using the hypothesis that Sl has non-empty interior, we conclude that Lui = 0, 
i.e., Ui g {/. Since i was arbitrary and a = 0, this yields (<x,wi, . . . ,u m ) = 0. 

This shows < y 9~ 1 (0) = {0}. Together with the fact that <p is a (quadratically) 
homogeneous map, this implies that is proper (see for example [PS, Lemma 2.7]). 
In particular, Cl = un<p is closed. 

Suppose now that / ^ K[2C]i \Cl- The task is to find x g Sl such that /(x) < 0. 
Being a closed convex cone, Cl is the intersection of all closed half-spaces containing 
it. Therefore we find a linear map ip : M.[X]i — > K such that iP{Cl) Q K>o an d 
tp(f) < 0. We can assume ip(l) > since otherwise ip(l) = and we can replace 
ip by ip + e ev y for some small e > where y € Sl is chosen arbitrarily. Hereby 
ev x : M.[X]i — > R denotes the evaluation in x G R™. Finally, after a suitable scaling 
we can even assume ip(l) = 1. 

Now setting ir := (V>(^i), • ■ • M X n)) € R", we have -0 = ev,,. So ip(C L ) C R> 
means exactly that i(x) >^ 0, i.e., x g Sl- At the same time f(x) = tp(f) < as 
desired. ■ 

3.2. Certificates for low-dimensionality of spectrahedra. As mentioned above, 
the problems with the standard duality theory for SDP arise when one deals with 
spectrahedra having empty interior. Every convex set with empty interior is con- 
tained in an affine hyperplane. The basic idea is now to code the search for such 
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an affine hyperplane into the dual SDP and to replace equality in the constraint 
f — a = tr(LS) of (D) by congruence modulo the linear polynomial I defining the 
affine hyperplane. This raises however several issues: 

First, Sl might have codimension bigger than one in R™. This will be resolved 
by iterating the search up to n times. 

Second, we do not see any possibility to encode the search for the linear polyno- 
mial £ directly into an SDP. What we can implement is the search for a non-zero 
quadratic sos-polynomial q together with a certificate of Sl Q {q — 0}. Note that 
{q = 0} is a proper affine subspace of R". It would be ideal to find q such that 
{q = 0} is the affine hull of Sl since then we could actually avoid the n-fold itera- 
tion just mentioned. However it will follow from Example 3.2.2 below that this is 
in general not possible. 

Third, we have to think about how to implement congruence modulo linear 
polynomials £ vanishing on {q = 0}. This will be dealt with by using the radical 
ideal from real algebraic geometry in connection with Schur complements. 

We begin with a result which ensures that a suitable quadratic sos-polynomial q 
can always be found. In fact, the following proposition says that there exists such a 
q which is actually a square. The statement is of interest in itself since it provides 
certificates for low-dimensionality of spectrahedra. We need quadratic (i.e., degree 
< 2) sos-matrices for this. 

Proposition 3.2.1. For any linear pencil L G SM.[X] mxm , the following are equiv- 
alent: 

(i) Sl has empty interior; 

(ii) There exists a non-zero linear polynomial £ G R[2C]i an d a quadratic sos- 
matrix S G SR\X] mXm such that 

-£ 2 =tr(LS). (12) 

Proof. From (ii) it follows that — £ 2 G Ml and therefore —I 2 > on Sl, which 
implies £ = on Sl- So it is trivial that (ii) implies (i). 

For the converse, suppose that Sl has empty interior. If there is u G R m \ {0} 
such that Lu = then, by an orthogonal change of coordinates on R m , we could 
assume that u is the first unit vector &\. But then we delete the first column and 
the first row from L. We can iterate this and therefore assume from now on that 
there is no u G R m \ {0} with Lu = 0. 

We first treat the rather trivial case where L is strongly infeasible. By Lemma 2.2.1, 
there are c G R>o and itj G R m with — 1 — c = J2i u i^ u i- By scaling the Ui 
we can assume c = 0. Setting S := J2i u i u i e SW nxm and £ := 1, we have 
— £ 2 = — 1 = J2i u i^ u i — t r (LS) for the constant sos-matrix S and the constant 
non-zero linear polynomial I. 

Now we assume that L is weakly infeasible or feasible. In case that L is feasible, 
it is clearly weakly feasible since otherwise Sl would have non-empty interior. Now 
Lemma 2.2.4 justifies the following case distinction: 

Case 1. There is u G R m \ {0} with u* Lu = 0. 

Write L = (£ij)i<ij< m - Again by an orthogonal change of coordinates on R m , 
we can assume that u = e\, i.e., l\\ = 0. Moreover, we may assume £ := £\2 ^ 
(since Le x = Lu ^ 0). Setting £' := ±(-1 - £ 22 ), v := [£' I 0. . .0]* and S := vv* , 
we have 

tr(LS) = v*Lv = 2£'Ui2 + £ 2 £ 2 2 = + 2t) = -£ 2 . 

Case 2. Case 1 does not apply but there are k > 2 and u\, . . . ,Uk G R m \ {0} 
such that J2i=i u *Lui = 0. 
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Here we set £ := u\Lu\ ^ and write -I = where £ x := \{-t+l) G 

and £ 2 := |M - x ) e R [2C]i- Th en we can use the quadratic sos-matrix 

k 

S := l\u\u\ + l\ UjwJ = £\u\u\ — t\u\u\ = —luiU* 



i=2 



to get tv(LS) = —lulLui 



The certificate (12) of low-dimensionality exists for some but in general not 
for every affine hyperplane containing the spectrahedron. We illustrate this by 
the following example where the spectrahedron has codimension two and therefore 
is contained in infinitely many affine hyperplanes only one of which allows for a 
certificate (12). 



Example 3.2.2. Let 



L 



' X x ' 
X\ X2 X 3 

x 3 x x 



Then Sl = {(0,X2,0) S R 3 | 12 > 0} and the (affine) hyperplanes containing Sl 
are {Xi = 0} and {aX\ + X3 = 0} (a € I). As is shown in Case 1 of the proof of 
Proposition 3.2.1, the certificate of low-dimensionality (12) exists for the hyperplane 
{Xi = 0}, i.e., there is a quadratic sos-matrix S such that — X\ = tr(LS). However, 
none of the other hyperplanes containing Sl allows for the certificate (12). 

Otherwise assume that there is a £ M such that {aX\ + X3 = 0} has a also cor- 
responding certificate. Combining it with the one for {X\ = 0}, we get a quadratic 
sos-matrix S such that 

-{2a 2 )Xl - 2(aX 1 + X 3 ) 2 = tr(LS) 

which implies 

-Xl = (2aX 1 + X 3 ) 2 + {-{2a 2 )Xl - 2(aX 1 + X 3 ) 2 ) e M L X) . 

Specializing X 3 to 1, one gets the contradiction — 1 £ M L , where L' is the linear 
pencil from Example 2.4.1. 

3.3. Iterating the search for an affine hyperplane. We now carry out the 
slightly technical but easy iteration of Proposition 3.2.1 announced in Subsection 
3.2 and combine it with Proposition 3.1.1. Wc get a new type of Positivstellensatz 
for linear polynomials on spectrahedra with bounded degree complexity. 

Theorem 3.3.1 (Positivstellensatz for linear polynomials on spectrahedra). 
Let L e SR[X] mxm be a linear pencil and f G R[X]i- Then 

/ > onS L 

if and only if there exist £\,...,£ n G K[X]i, quadratic sos-matrices Si,...,S n G 
SR[X] mxm , a matrix S G SR™*" 1 andc>0 such that 

l\ + tr(LSi) G (£\, . . . A-i) for ie{l,...,n}, and (13) 
f-c-tv(LS) G (h,... A). (14) 

Proof. We first prove that / > on Sl in the presence of (13) and (14). 

The traces in (13) and (14) are elements of Ml and therefore nonncgative on 
Sl- Hence it is clear that constraint (14) gives / > on Sl if wc show that li 
vanishes on Sl for all i G {1, . . . ,n}. Fix i G {1, . . . ,n} and assume by induction 
that £1, . . . ,£i-i vanish on Sl- Then (13) implies £f + ti(LSi) vanishes on Sl and 
therefore also L. 
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Conversely, suppose now that / > on Sj,. We will obtain the data with 
properties (13) and (14) by induction on the number of variables n e No- 

To do the induction basis, suppose first that n = 0. Then / > on Sl just means 
that the real number / is nonnegative if L 6 SK mxrn is positive semidefinite. But 
if / > 0, then it suffices to choose c := / > and S := to obtain (14) with 
n = 0, and the other condition (13) is empty since n — 0. We now assume that 
/ < and therefore L ^ 0. Then we choose u G W n with u*Lu = /. Setting 
S := uu* e 5R™ xm and c := 0, we have 

/ - c - tr(LS) = / - u*Lu = f - f = 0, 

as required. 

For the induction step, we now suppose that n G N and that we know already 
how to find the required data for linear pencils in n — 1 variables. We distinguish 
two cases and will use the induction hypothesis only in the second one. 

Case 1. Sl contains an interior point. 

In this case, we set all £i and Si to zero so that (13) is trivially satisfied. Property 
(14) can be fulfilled by Proposition 3.1.1. 
Case 2. The interior of Sl is empty. 

In this case, we apply Proposition 3.2.1 to obtain O^li £ K[A]i and a quadratic 
sos-matrix Si G SR[X] mxm with 

e{ + tx{LSx) = Q. (15) 

The case where £\ is constant is trivial. In fact, in this case we can choose all 
remaining data being zero since {£\, . . . ,£i) = (£\) = M.[X] for all i <G {1, . . . ,n}. 

From now on we therefore assume i\ to be non-constant. But then the reader 
easily checks that there is no harm carrying out an affine linear variable trans- 
formation which allows us to assume i\ = X n . We then apply the induction hy- 
pothesis to the linear pencil L' := L(Xi, . . . ,X„_x,0) and the linear polynomial 
/' := f(Xi, . . . ,X n -x,0) in n — 1 variables to obtain £2, ■ ■ ■ ,£ n G quadratic 
sos-matrices S 2> . . . ,S n € SR[X] mxm , a matrix S € SR™* m and a constant c > 
such that 

t\ + ti(L'Si) G (£2, ■ ■ ■ A-l) for i€{2,...,n} and (16) 
/'-c-tr(L'S)G (£ 2 ,...,e n ). (17) 

Noting that both f — f and ti(LSi) — ti(L'Si) = ti((L — L')Si) are contained in 
the ideal (X n ) = (£1), we see that (16) together with (15) implies (13). In the same 
manner, (17) yields (14). ■ 

3.4. The real radical and Schur complements. Let L 6 SK.[X] mxm be a linear 
pencil and q G M\X] a (quadratic) sos-polynomial such that — q = tr(LS) for some 
(quadratic) sos-matrix S like in (12) above. In order to resolve the third issue 
mentioned in Subsection 3.2, we would like to get our hands on (cubic) polynomials 
vanishing on {q = 0}. In other words, we want to implement the ideals appearing 
in (13) and (14) in an SDP. 

Recall that for any ideal X C its radical y/T and its real radical \/X are 

the ideals defined by 

VT := {p G R\X] I 3k e N : f k £ 1} and 

\/I:={p£ R[X] I 3k e N : 3s € ^M[X] 2 : f 2k + sel}. 

An ideal X C WL[X] is called radical if X = y/T and real radical if X = \fX. 

By the Real Nullstcllcnsatz [BCR, Ma, PD], each polynomial vanishing on the 
real zero set {q = 0} of q lies in U(q). This gives a strategy of how to find the 
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cubic polynomials vanishing on {q = 0}, cf. Proposition 3.4.1 and Lemma 3.4.2 
below. The Real Nullstellensatz plays only a motivating role for us. We will only 
use its trivial converse: Each element of \f{q) vanishes on {q = 0}. 

The question is now how to model the search for elements in the real radical 
ideal by SDP. The key to this will be to represent polynomials by matrices as it is 
done in the Gram matrix method mentioned at the beginning of Section 3. For this 
we have to introduce notation. 

For each d £ No, let s(d) := dimMfXjd = denote the number of monomials 

of degree at most d in n variables and \X] d G M[X] S ^ the column vector 

\X] d := [1 X x X 2 ... X n X\ X X X 2 XfX 

consisting of these monomials ordered first with respect to the degree and then 
lexicographic. 

The following proposition shows how to find elements of degree at most d + e 
(represented by a matrix W) in the real radical I := y/Jqj of the ideal generated 
by a polynomial q £ R[2C]2d (represented by a symmetric matrix U, i.e., q = 
\2L]d*U[X]d). Wc will later use it with d= 1 and e = 2 since q will be quadratic and 
we will need cubic elements in I. Note that 



u y w*w 



i w 

w* u 



y o 



by the method of Schur complements. 

Proposition 3.4.1. Let d,e £ N , 1 a real radical ideal ofR[X] and U £ SR'^*^ 
such that^\X} d *U\X] d £ I. Suppose W £ W^ xs ^ with U h W*W. Then 

\X]eW\X] d £ 1. 

Proof. Since U — W*W is positive semidefinite, we find B £ R s ( d ) xs ( d ) with U — 
W*W = B*B. Now let p { £ R[X] denote the i-th entry of W\X] d and qj the j-th 
entry of B\X] d . From 

Pl + ---+P 2 s (e)+ll + --- + 9s(d) = (W\T] d yW[X] d + {B\X] d )*B[X] d 

= [X]d*(W*W + B*B)\X]d = \X] d U\X] d £l 
it follows that pi, ■ ■ ■ ,p s (e) € T- since X is real radical. Now 

[X] e *W[X] d = [X] e *[ Pl . . . Ps{e) }* = \p!.. .Ps{e)}[X] e G T 

since I is an ideal. ■ 

The following lemma is a weak converse to Proposition 3.4.1. Its proof relies 
heavily on the fact that only linear and quadratic polynomials are involved. 

Lemma 3.4.2. Suppose £i,...,£ t £ R[X]i and q x ,...,q t £ K[X] 2 . Let U £ 
£ MS (i)x s (i) be such that 



Wi U\x] 1 = f 1 



Then there exists A > and W £ Hr( 2 )xs(i) such that xu y w * w and 

ma'Wgii =hqi + ---+£ t qt- 

Proof. Suppose that at least one q% ^ (otherwise take W = 0). Choose column 
vectors a £ R s(2) such that c*\X} 2 = q%. Now let W £ R s ( 2 ) Xs ( 1 ) be the matrix 
defined by W^]i = Y^i=i so that 

t t t 

2—1 l — l 4 — 1 
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Moreover, we get 



[x\i*W*W[x]i = (W\x)i)*W\x]i = E (tiCiTVjCi) 



and therefore for all x £ K™ 

1 



[1 X X ... X n ] W*W 



= x; (^(x)ci)*(^(x) Ci ) 



t 

< 



t t 



(x)\ 



i=l i=l 

where we set A := i^ i=1 c*c,; > 0. Therefore 

[1 xi ... a; n ] (Ai7 - [1 xi ... x„]*>0 

for all x £ M. n . By homogeneity and continuity this implies y*{\U — W*W)y > 
for all y £ R*W, i.e., AC/ ^ W*W. ■ 

3.5. The sums of squares dual of an SDP. Given an SDP of the form (P) 
described in Subsection 3.1, the following is what we call its sums of squares dual: 

maximize a 

subject to S £ SW nxm , S h 0, a £ R 

Si,... ,S„ £ SR[X] mxm quadratic sos-matrices 
Ui,...,U n £ SR'W^'W 
Wi,...,W n £ R 8 ( 2 ) X8 W 

mi*UiWi + a*^-iEi + tr(i5 4 ) = (* £ {1, . . . ,n}) 

(*€{l,...,n}) 

I - a+ \X] 2 *W n \X]i ~ tr(L5) = 0. 

Just like Ramana's extended Lagrangc-Slatcr dual [Ra] it can be written down 
in polynomial time (and hence has polynomial size) in the bit size of the primal 
(assuming the latter has rational coefficients) and it guarantees that strong duality 
(i.e., weak duality, zero gap and dual attainment, see Subsection 3.1) always holds. 
Similarly, the facial reduction [BW, TW] gives rise to a good duality theory of SDP. 
We refer the reader to [Pat] for a unified treatment of these two constructions. 

As mentioned at the beginning of Section 3, the quadratic sos-matrices can easily 
be modeled by SDP constraints using the Gram matrix method, and the polynomial 
identities can be written as linear equations by comparing coefficients. 

The Si serve to produce negated quadratic sos-polynomials vanishing on Sl 
(cf. Proposition 3.2.1) which are captured by the matrices f/,. From this, cubics 
vanishing on Sl are produced (cf. Subsection 3.4) and represented by the matrices 
Wi- These cubics serve to implement the congruence modulo the ideals from (13) 
and (14). The whole procedure is iterated n times. 

Just as Proposition 3.1.1 corresponds to the standard SDP duality, Theorem 
3.5.2 translates into the strong duality for the sums of squares dual. Before we 
come to it, we need a folk lemma which is well-known (e.g. from the theory of 
Grobner bases) and which we prove for the convenience of the reader. 
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Lemma 3.5.1. Suppose d E N, f E R[X]d and £i, . . . ,£t G are non-constant 

linear polynomials such that f E (£i, . . . ,£ t )- Then there exist p\, . . . ,p t E R[2C]d-i 
such that f = p\£i + • • • + pt£t ■ 

Proof. We proceed by induction on f e No. For t — 0, there is nothing to show. 
Now let t E N and suppose the lemma is already proved with t replaced by t — 1. 
We may assume that £\ = X\ — £ with £ E R[X 2 , . . . ,X n ] (otherwise permute the 
variables appropriately and scale £\). Write / = J^laKd a a2£ a with a a E R. Setting 
g := f(£,X 2 , ■ ■ ■ ,X n ), we have 

f-g= a a (X^ -£^)Xr----X^ =p 1 {X 1 -£)= Pl £ 1 

\a\<d 
l<ai 

where Pl := £ \*\<d a a (EZo ' X^ 1 ^) X^ ■ ■ ■ X%» E R[X]d-i- Moreover, 

g E (£ 2 , ■ ■ ■ A) and therefore g = p 2 £ 2 H h pA for some p 2 , . . . ,p t G R[X] d _i by 

induction hypothesis. Now 

f = (f-g)+9 = Pih + ---+Pt£t. ■ 

Theorem 3.5.2 (Sums of squares SDP duality). Let L E SR[X] mXm be a linear 
pencil and f E R[X]i- Then 

/ > onS L 

if and only if there exist quadratic sos-matrices Si, . . . ,S n E SR[X] mxm , matrices 
Ui,...,U n € SR s ^ Xs ^, W u ...,W n E tt'CO*'* 1 ), S E SR^ xm and c € K> such 
that 

\x] 1 *U i \X] 1 + \X] 2 *Wi-iW 1 +tT(LS i ) = (i6{l,...,n}), (18) 

UihW*Wi (ie{l,..,n}), (19) 

f -c+[X]2*W n [X] 1 -tr(LS) = 0, (20) 
where Wq := 0. 

Proof. We first prove that existence of the above data implies / > on Sl- All we 
will use about the traces appearing in (18) and (20) is that they are polynomials 
nonnegative on Sl ■ Let I denote the real radical ideal of all polynomials vanishing 
on Sl- It is clear that (20) gives / > on Sl if wc show that [X]2W ra [X]i <G X. In 
fact, we prove by induction that [X]2*Wj[X]i € X for all i G {0, . . . ,n}. 

The case i = is trivial since Wo = by definition. Let i G {1, . . . ,n} be given 
and suppose that \X\ 2 * Wi-i\X\i € X. Then (18) shows \X\\^^\\ < on S L . On 
the other hand (19) implies in particular Ui>z0 and therefore [X ] 1 * Ui \X] 1 > on Sl- 
Combining both, \X]i*Ui\X\i G X. Now Proposition 3.4.1 implies fx^W'ijxh G X 
by (19). This ends the induction and shows / > on Sl as claimed. 

Conversely, suppose now that L is infcasiblc. By Theorem 3.3.1 and Lemma 
3.5.1, we can choose £1, . . . ,£ n & R[X}i, quadratic sos-matrices S[, . . . ,S' n E SR[X} m> 
S E SR™ Xm and qij G R\X] 2 (1 < j < i < n) such that 

i-l 

ei + ---+4 + tr(LS' i ) = Y,<Ki-i)jtj (i G {1, . . . ,n}) and (21) 

3=1 

n 

f-c-tv(LS) = J2lnj£ j - (22) 

There are two little arguments involved in this: First, (13) can trivially be rewritten 

as £\ H Mf + tr(L£Q G (4, - • • A-i) for i G {1,. . . ,n}. Second, in Lemma 3.5.1 

the £i are assumed to be non-constant but can be allowed to equal zero. But if 
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some £i ^ is constant, then we may set ii+i = ■ ■ ■ = l n = and 5* 4 ' +1 = • • • = 
S' n = 5 = 0. 

Now define U'i G SW>W**W by [x|i*C//[X]i = t\ + ■ ■ ■ + l\ for i G {1, . . . ,n}. 
Using Lemma 3.4.2, we can then choose A > and W[ , . . . ,W£ G R*( 2 ) X *W such 
that 

Af/i h W'*W{ (23) 

and [X]2*W/[X]i = -X)i=x?ij^J for * e {!> •••>"}• Setting W n := equation 
(22) becomes (20). Moreover, (21) can be rewritten as 

ffli*^tSi + ^]2*Wr-i[xli+tr(L^) = (i e {1, . . . ,n}) ( 24 ) 
To cope with the problem that A might be larger than 1 in (23), we look for 
Ai, . . . ,A„ G K >0 such that U t h W*Wi for aU % G {1, . . . ,n} if we define U t := A^' 
and := \ i W' i _ l for all i G {l,...,n} (in particular W = = 0). With 

this choice, the desired linear matrix inequality (19) is now equivalent to \iU[ >z 
>H+\Wl*Wl for i G {1, . . . ,n — 1} and A„f74 >: W£ 2 . Looking at (23), we therefore 
see that any choice of the Ai satisfying A; > AA 2 +1 for i G {1, . . . ,n — 1} and A„ > A 
ensures (19). Such a choice is clearly possible. Finally, equation (24) multiplied by 
Ai yields (18) by setting Si := AiS 1 - for i G {1, . . . ,n}. ■ 

3.6. The real radical and the quadratic module. Let L be a linear pencil. In 
Definition 1.2.1, we have introduced the convex cone Cl C R[X]i and the quadratic 
module Aft C M.[X] associated to L consisting of polynomials which are obviously 
nonnegative of the spectrahedron Sl- In Theorem 2.2.5, we have shown that the 
quadratic module Aft can be used to certify infeasibility of L, in the sense that 
Sl = implies —1 G Aft- On the contrary, we have seen in Subsection 2.4, that 
the convex cone Ct is in general too small to detect infeasibility of L in this way. 

In this subsection, we turn over to the more general question of certifying non- 
negativity of arbitrary linear polynomials on Sl (as opposed to just the constant 
polynomial —1). The following example shows that Aft (and henceforth its subset 
Cl) does not, in general, contain all linear polynomials nonnegative on Sl- 

Example 3.6.1. Consider 

L-\ l X ' 

L -[x / 

Then Sl = {0}. Hence obviously X > on Sl- But it is easy to see that X £ Ml 
[Za, Example 2]. 

Despite this example, Theorem 3.3.1 and its SDP-implcmcntablc version Theo- 
rem 3.5.2 do on the other hand yield algebraic certificates of linear polynomials non- 
negative on Sl ■ These two theorems have the advantage of being very well-behaved 
with respect to complexity issues but have the drawback of their statements being 
somewhat technical. Leaving complexity issues aside, one can however come back 
to a nice algebraic characterization of linear polynomials nonnegative on Sl ■ 

Given / G 1R[2C]i with / > on Sl, the certificates in Theorems 3.3.1 and 3.5.2 
for being nonnegative on Sl can actually be interpreted as certificates of / lying 
in the convex cone Ct + \J supp Ml by means of Prestel's theory of semiorderings. 
Note that each element of Ct + V SU PP Ml is of course nonnegative Sl since the 
elements of -y/supp Aft vanish on Sl ■ 

Finally, this will allow us to come back to the quadratic module Aft. We will 
show that it contains each linear polynomial nonnegative on Sl after adding an 
arbitrarily small positive constant, see Corollary 3.6.7. 

In this subsection, basic familiarity with real algebraic geometry as presented 
e.g. in [BCR, Ma, PD] is needed. The following proposition follows easily from Pres- 
tel's theory of semiorderings on a commutative ring, see for example [Sc, 1.4.6.1]. 
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Proposition 3.6.2. Let M be a quadratic module in M.[X]. Then 

y/ supp M = ^/supp M = (^jjsuppS | S semiordering ofM\X],M C S}. 

We explicitly extract the following consequence since this is exactly what is 
needed in the sequel. 

Lemma 3.6.3. Let M be a quadratic module in M.[X]. Then 

(y/suppM - M) n M C ^supp M. (25) 

Proof. To prove (25), suppose p £ M can be written p = g — q with g £ ^/supp M 
and q £ M. By Proposition 3.6.2, we have to show that p £ supp S for each 
semiordering 5 of HL\X] with M C 5. But if such S is given, then g £ supp 5 and 
therefore p = g — q £ —S as well as p £ M C S 1 . Hence p £ supp S. ■ 

Having this lemma at hand, we can now give a conceptual interpretation of 
the certificates appearing in Theorem 3.3.1, disregarding the complexity of the 
certificate. 

Proposition 3.6.4. If L £ SR[X] mxm is a linear pencil, f,l y ,...,l n £ R[X] U 
Si,... ,S n £ SR[X] rnxm are quadratic sos-matrices, S £ SR™ xm and c £ R> such 
that (13) and (14) hold, then f £ Cl + \/supp Ml . 

Proof. Set I := \/supp Ml . It is clear that (14) gives / £ Cl + T if we prove 
that £i £ T for all i £ {1, ...,n}. Fix i £ {1, ...,n} and assume by induction 
that £i, . . . £ X. Then (13) implies If + tv(LS % ) £ 1 and therefore £| G 

(i - M L )r\J2Mx] 2 c (i- M L )nM L ciby (25). ' ■ 

We get the same interpretation for the certificates from Theorem 3.5.2. 

Proposition 3.6.5. If L £ SR[X] mxm is a linear pencil, f £ R[X]i, Si,... ,S n £ 
SR[X] mxm are quadratic sos-matrices, Ui,...,U n £ SR s(1 ^ xs(1 \ Wi,...,W n £ 
R'Wx'W, S £ SR™ xm and c £ R> such that (18), (19) and (19) hold, then 

f £C L + Vsupp M L - 

Proof. Set 1 := y/supp Ml . It is clear that constraint (20) gives / G Cl +X if we 
show that [X]2W n [X]i G 1. In fact, we show by induction that [X]2H / i[X]i G I for 
all i £ {0, . . . ,n}. 

The case i = is trivial since Wo = by definition. Let i £ {l,...,n} be 
given and suppose that we know already G T. Then (18) shows 

\X]i Ui[X]i £ T — Ml- On the other hand (19) implies in particular Ui >: and 
therefore \X\i*Ui\X]i £ J2 R [2£? C M L . But then \X]i*Ui\X]i £ (X-M L )nM L C 1 
by (25). Now (19) yields \X} 2 Wi\X\i G ^ by Proposition 3.4.1 since X is real radical 
by Proposition 3.6.2. This ends the induction. ■ 

The following corollary is now a generalization of Proposition 3.1.1 working also 
for low-dimensional Sl (note that supp Ml = (0) if Sl has non-empty interior) . 

Corollary 3.6.6. Let L £ SE.[X] mxm be a linear pencil. Then 

/ > onS L ^ f £C L + VsuppM L 

for all f £ R\X]i. 

Proof. Combine cither Theorem 3.3.1 with Proposition 3.6.4, or Theorem 3.5.2 with 
Proposition 3.6.5. ■ 

Now we come back to the quadratic module where we cannot avoid to add e > 
in order to get a certificate as was shown in Example 3.6.1. 
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Corollary 3.6.7. Let L £ SR\X] f 
f > on S L 

for all f G R[X]i. 



be a linear pencil. Then 
> Ve>0:f + seM L 



Proof. To prove the non-trivial implication, let / £ M[X]i with / > on Sl be 
given. It suffices to show / + e £ Ml for the special case e = 1 (otherwise replace / 
by ef and divide by e). By Corollary 3.6.6, there exists g £ Cl,P £ R[2£] and k £ N 
such that f = g+p and p k £ X := supp M l ■ Now f + s = f+ l = g+{f-g) + l = 
g + (p + 1) and it is enough to show that p+1 £ Ml . This will follow from the fact 
that the image of p + 1 is a square in the quotient ring Ht\X]/I. Indeed since the 
image of p in R[X]/X is nilpotent (in fact the image of p k is zero), we can simply 
write down a square root of this element using the finite Taylor expansion at 1 of 
the square root function in 1 given by the binomial series: 

y 2 



P- 



fh-\ 

E 



p 



mod X. 



4. MATRICIAL SPECTRAHEDRA AND COMPLETE POSITIVITY 

In this section we revisit some of the main results from [HKM], where we con- 
sidered noncommutative (matricial) relaxations of linear matrix inequalities under 
the assumption of strict feasibility. The purpose of this section is twofold. First, 
in Subsection 4.2 we explain which of the results from [HKM] generalize to weakly 
feasible linear matrix inequalities. Second, in Subsection 4.3 we explain how our 
results from Section 3 pertain to (completely) positive maps under the absence of 
positive definite elements. 

4.1. Matricial relaxations of LMIs. Suppose 

n 

L = A +Y^ XiAi 

i=l 



is a linear pencil of size m. Given Z = col(Zi, 
evaluation L(Z) is defined as 



,Z n ) '■- 



Zi 



£ (SR dxd ) n , the 



L(Z) =I d ®A + )Z i ®A i e 



ndmxdm 



i=l 



The matricial spectrahedron of a linear pencil L is 

& L := \J{Z £ (SR dxd ) n | L(Z) h 0}. 



del 



Let 



& L {d) = {Z £ {SR dxd ) n | L(Z) h 0} = & L n (SR dxd ) n . 

for d £ N. The set ©l(1) Q K ra is the feasibility set of the linear matrix inequality 
L(x) y and coincides with Sl as introduced above. We call &l bounded if there 
is an TV £ N with operator norm \\Z\\ < TV for all Z £ &l- 

Lemma 4.1.1. For matrices Zi, . . . ,Z n of the same size, we have 



\co\(Z 1 ,...,Z n )\\ : 



i=l 



Zi Zi 
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Proof. Suppose Z 3 - e R dxd . Expand col(Zi, . . . ,Z n ) E R dnxd to a dn x matrix 
i? by adding zero columns. Then 

\\col(Z 1 ,...,Z n )\\ 2 = \\Z\\ 2 = \\Z*Z\\ 

~T,i z i z i o ••• o 

■•• 
••• 

Given linear pencils L\ and L2, 

n 

^ = ^,0 + J! X *A* e 5K[^]r Xmj , 3 = 1,2, (26) 

i=l 

we shall be interested in the following inclusion for matricial spectrahedra: 

6 Ll C6 i2 . (27) 

In this case we say that L\ matricially dominates L^. If L2 E M.[X]i then (27) is 
equivalent to Sli C 5i 2 : 

Proposition 4.1.2. Lei L be a linear pencil of size m and let I £ R[X]i- TTien 

*k > ^ *| ei >= 0. 

Proof. The implication -<= is obvious as &l 3 Sl- For the converse assume £\& L ^ 
and choose Z = (Zi, . . . ,Z n ) 6 61 with £(Z) ^ 0. Let « be an eigenvector of £(Z) 
with negative eigenvalue. For v*Zv = (v* Z\v, . . . ,v* Z n v) £ Sl we have 

L(v*Zv) = (I m <g> v)*L(Z)(I m ®v)h0, 

and 

> v*£(Z)v = e(v*Zv), 
whence l\g L ^ 0. ■ 

Corollary 4.1.3. Let L be a linear pencil. Then 

&l is bounded Sl = &l(X) is bounded. 

Corollary 4.1.4. For a linear pencil L, &l = if and only if Sl = • 

Since empty spectrahedra were thoroughly analyzed in previous sections, in the 
sequel wc shall always assume Sl 7^ 0- Moreover, we assume that there is Z £ &l 
with L(Z) 7^ 0. Then, by compressing and translating, we ensure 

(Asmp) ^ A a h 0. 

If the interior of Sl is non-empty, we could further reduce to strictly feasible linear 
pencils (cf. [HKM, Proposition 2.1]), but this is not the case we are interested in 
here. 

Lemma 4.1.5. If Sl is bounded, then A$, . . . ,A n are linearly independent. 

Proof. This is easy; or see [HKM, Proposition 2.6(2)]. ■ 

Wc now introduce subspaces to be used in our considerations: 

S>3 = Bpan{i4j,i \ i = Q,...,n} = span{L^(z) | z e IT} C SR™* xm J . 

We call = Sf(Lj) the (nonunital) operator system associated to the linear pencil 
Lj. Conversely, to each linear subspace 5? C SW mxm we can associate a linear 
pencil L with = .^(L) by fixing a basis for S?. We can even enforce additional 
properties on L, see Proposition 4.3.2 below. 

The key tool in studying inclusions of matricial spectrahedra as in (27) is the 
linear map r : 5?{L\) — > ^{L^) we now define. 



zZ z t z i 

i 
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Definition 4.1.6. Let L\,L^ be linear pencils as in (26). If A\ t Q, . . . ,A\^ n are 
linearly independent (e.g. Sl x is bounded), we define the linear map 

t-.S^^-S^, A hi ^A 2 ,i (i = 0,...,n). 



We shall soon see that, assuming (27), r has a property called complete positivity, 
which we now introduce. Let S*j C SM. mjXmj be linear subspaces and ip : S?\ — > ^2 
a linear map. For d £ N, <j> induces the map 



Vd = i d ®ip:m d ' Kd ®y 1 = y[ 

called an ampliation of ip. Equivalently, 



dxd 



dxd 



M® A i-> M(g) ^(A), 



T11 



Y>( T dl) 



Id J 



for g We say that ip is d-positive if is a positive map, i.e., maps positive 
semidcfinite matrices into positive semidefinite matrices. If ip is d-positive for every 
d € N, then y> is completely positive. 

Remark 4.1.7. If S?\ does not contain positive semidefinite matrices, then every 
linear map out of is completely positive. On the other hand, under the presence 
of positive definite elements there is a well established theory of completely positive 
maps, cf. [Pau]. In the absence of positive definite elements in the structure 
of completely positive maps out of 5?\ seems to be more complicated, and our 
results from Section 3 describe (completely) positive maps — > K in this case; see 
Subsection 4.3 below. 

4.2. The map r is completely positive: LMI matricial domination. The 

main result of this section is the equivalence of d-positivity of the map r from 
Definition 4.1.6 with the inclusion &L 1 (d) C &L 2 (d). As a corollary, L\ matricially 
dominates Li if and only if r is completely positive. 



Let 



Theorem 4.2.1 (cf. [HKM, Theorem 3.5 

71 

J2 X t A jti € SR[X]f 



L, = A 



d-i x dj 



3,0 



1,2 



i=l 



be linear pencils (with 7^ A1.0 >z 0), and assume the spectrahedron Sl x is bounded. 
Let t be the linear map given in Definition J^.1.6. 

(1) r is d-positive if and only if&L 1 (d) C ©L 2 (d); 

(2) t is completely positive if and only if&L 1 C &l 2 . 

We point out that in [HKM] this theorem has been given under an additional 
assumption: the linear pencil L\ was assumed to be strictly feasible. 
To prove the theorem we start with a lemma. 

Lemma 4.2.2. Let L = Aq + X)"=i A^A.; be a linear pencil of size m with 7^ 
Aq defining a bounded spectrahedron Sl- Then: 

(1) if A e W lxd and Z G (SR dxd ) n , and if 



is symmetric, then A 
(2) ifShO, then A t 0. 



S := A(g) An + 



A* 



A,- 



(28) 
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Proof. To prove item (1), suppose S is symmetric. Then = S—S* = (A— A*)®Aq. 
Since A ^ 0, A = A*. 

For (2), if A ^ 0, then there is a unit vector v such that v* Av < 0. Consider 
the orthogonal projection P G SR dmxdm from R d ® K m onto ® R m , and let 
Y = ((v*Ziv)P v )f =1 G (S , R dxd ) n . Here P u G SK**** is the orthogonal projection 
from R d onto Mv. Note that P = P v J m . Then the compression 

n n 

P5P = P(A ® A + ^2 Z { ® Ai)P = (w'AwJP, ® A + Y i ® ^ >= 0> 

i=l i=l 

which says that 7^ ^4 h since ^ A _; and v*Av < 0. This implies 

^ tY £ ©l for all i > 0; contrary to &l being bounded. ■ 

Proof of Theorem 4.2.1. In both of the statements, the direction (=>) is obvious. 
We focus on the converses. 

Fix d G N. Suppose S £ ydxd j g p 0S j^j ve semidefmitc. Then it is of the form 
(28) for some A G R dxd and Z G {SR dxd ) d : 

n 

S = A ® Ai, + ^ ® A M >r 0. 

i=l 

By Lemma 4.2.2, T >z 0. If we replace A by A + el for some e > 0, the resulting 
5 = S E is still in y dxd , so without loss of generality we may assume A y 0. Hence, 

n 

(A - * ®/)5(A-5 ® J) = 7® Ai, + ^(A-5ZiA-3)® A M h 0. 

i=l 

Since ©i(d) C ©2(d), this implies 

n 

7® A 2i0 + ^(A"2Z ; A-5) 0^ 2 i >- 0. 
»=i 

Multiplying on the left and right by A 2 <g> I shows 

n 

t(S £ ) = A <g> A 2 , + Y z i ® >: 0. 

An approximation argument now implies that if S* ^ 0, then r(S') >: and hence r 
is d-positive proving (1). Item (2) follows immediately. ■ 

We next use the complete positivity of r under the assumption of LMI matri- 
cial domination to give an algebraic characterization of linear pencils L\ and L2 
producing an inclusion @l 1 C &l 2 . 

Corollary 4.2.3 (Linear Positivstellensatz, cf. [HKM, Theorem 1.1]). Let L\ and 

L2 be linear pencils of sizes mi and 777,2, respectively. Assume that 6x 1 is bounded 
and SP\ contains a positive definite matrix (e.g. L\ is strictly feasible). Then the 
following are equivalent: 

(i) 6 Ll C6 i2 ; 

(ii) there exist /j£N and V G R^ miXm2 such that 

7 2 = 1/*(7 M ®7 1 )V. (29) 
Before turning to the proof of the corollary, we pause for a remark. 
Remark 4.2.4. Equation (29) can be equivalently written as 

3=1 
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where V* £ 



and V = col(Vi, . . . ,V M ). Moreover, /Lt can be uniformly 



bounded by Choi's characterization [Pau, Proposition 4.7] of completely positive 
maps between matrix algebras. In fact, [i < mim 2 - 

Proof of Corollary 4.2.3. The proof of the nontrivial implication (i) => (ii) proceeds 
as follows. First invoke Arveson's extension theorem [Pau, Theorem 7.5] to extend 
t from Definition 4.1.6 to a completely positive map V : R miXmi -> R m ^ xm \ 
(Caution: this is where the existence of a positive definite matrix in o5^i is used.) 
Then apply the Stinespring representation theorem [Pau, Theorem 4.1] to obtain 

i>{a) = V*x(a)V, aeW niXmi (31) 

for some unital ^-representation tt : R miXmi -> t m!X "' 3 and V : IR™ 1 -> W ns . By 
dissecting the proof (or see [HKM, pp. 12-14]) we see that n is (unitarily equivalent 
to) a multiple of the identity representation, i.e., 7r(a) 
all a g E miXmi . Hence (31) implies (29). 



In,® a for some /i£N and 



4.3. Examples and concluding remarks. 

Example 4.3.1. Let us revisit Example 3.6.1 to show that the existence of a 
positive definite matrix in 5f\ is needed for Corollary 4.2.3 to hold. Consider 

'1 X\ 



X 



Lo =X. 



Then Sl-l = {0} and &l 1 = {0}. Hence obviously &l 1 C &l 2 - However, L 2 does 
not admit a representation of the form (30). Indeed, such a certificate is equivalent 
to X g Cij ; but it was already pointed out that X is not even a member of Ml 1 . 

We finish this paper by showing how our Theorem 3.3.1 (cf. Theorem 3.5.2) 
pertains to positive maps y — >• K for a linear subspace 5? C STR 1 ™*" 1 . For this we 
start by associating to y a linear pencil L with S^{L) = ^ and bounded Sx. 

Proposition 4.3.2. Let 5? C STR" 1 *'" fee a linear subspace of dimension n + 1 > 2 
containing a nonzero positive semidefinite matrix. Then there exist Aq,Ai , . . . , A„ g 

(1) >= 0; 

(2) ^ = span{^ ,...,A„}; 

(3) /or i/ie linear pencil L := Aq + X\Ai + ■ 
bounded. 



X n A n the spectrahedron Sl is 



Proof. We will use the trace inner product 

(A,B) h-> (A,B) 



ti(AB) 



on 



Let Aq be a maximum rank positive semidefinite matrix in 5? . Without loss of 
generality we may assume 

, _ Us 

A °-[o o rn _ 

for some 1 < s < m. 

Claim. If for some A\ = 
(Aq,Ax) = and 

A + XAi — ^ Mh 

then A\ = 0. 

Explanation. Since (Aq,Ai) = 0, ti(An) = 0. This means that either An = or 
An has both positive and negative eigenvalues. In the latter case, fix an eigenvalue 



An 
I* 

^12 



A V2 
A 2 2 

XAi 2 
XA 22 



g y with An e 



y for all A g 



we have 



(32) 
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// < of An- Then for every Ael with A > > 0, we have that I s + XAn ^ 0, 

contradicting (32). So An = 0. If s = m we are done. Hence assume s < m. 
Now 

" Is XA 12 
XA* 12 XA 22 



> (33) 



A Q + XAi 

for all A E M>o- Using Schur complements, (33) is equivalent to 

XA 22 - X 2 A* 12 A 12 h 0. 

Hence A 22 - XA{ 2 A i2 y for all A E R> . Equivalently, A 12 = and A 22 y 0. If 
A 22 ^ 0, then X v4 + A x 6 ^, and 

,s = rank(ylo) < rank(Ao + Ai), 

contradicting the maximality of the rank of Aq . □ 

Take an arbitrary orthogonal basis Aq,Ai, . . . , A n of ,5? containing Aq, and let 
L := A + X\A\ + • • • + X n A n . We claim that Sl is bounded. 

Assume otherwise. Then there exists a sequence (x^)u in R™ such that ||x( fc ) || = 
1 for all fc, and an increasing sequence tu E R>o tending to oo such that L^kX^) >z 
0. By convexity this implies t^x^ E Sl for all r > k. Without loss of generality we 
assume the sequence (x^)k converges to a vector x = {x\, . . . ,x n ) E E n . Clearly, 
\\x\\ = 1. For any t E K>o, tx^> -t tx, and for k big enough, tx^ E Sl by 
convexity. So x satisfies L(tx) >z for all t E K>o- In other words, 

Ao + tfaAi + --- + x n A n ) > 

for all t E K>o- But now the claim implies xiAi + ■ ■ ■ + x n A n = 0, contradicting 
the linear independence of the Aj . ■ 



Lemma 4.3.3. Suppose C SM mxrn is a linear subspace and ip : 5? — >• R is a 
positive map. Then ip is completely positive. 

Proof. This is well-known and easy, cf. [Pau, Proposition 3.8 or Theorem 3.9]. ■ 



As seen in Example 4.3.1 there does not exist a clean linear certificate for LMI 
matricial domination (or, equivalently, complete positivity). However, our Theorem 
3.3.1 yields a nonlinear algebraic certificate for LMI (matricial) domination Sl Q Sf 
in the case / is a size 1 linear pencil, i.e., / E R[X]i- Equivalently, Theorem 3.3.1 
can be used to describe (completely) positive maps t : 5? — > M., where 5? C SW mxm 
is a(ny) linear subspace. 

Indeed, suppose ^ contains a nonzero positive semidefinite matrix (otherwise r 
is automatically completely positive) and apply Proposition 4.3.2 to obtain a basis 
Aq, . . . , A n of J?, and the linear pencil 

L:= A +X 1 A 1 +---+X n A n 

of size m with bounded Sl ■ Define 

/ := t(A ) + X lT (Ai) + ■■■+ X n r(A n ) E R[X]i. 

Then, by Theorem 4.2.1 (here is where the boundedness of Sl is used), r is com- 
pletely positive if and only if &l Q & j. By Proposition 4.1.2 the latter is equivalent 
to Sl Q Sf, i.e., f\s L > 0, and this is a situation completely characterized by The- 
orem 3.3.1. 
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